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Abstract — In this paper we present regular bilayer LDPC 
convolutional codes for half -duplex relay channels. For the binary 
erasure relay channel, we prove that the proposed code construc- 
tion achieves the capacities for the source-relay link and the 
source-destination link provided that the channel conditions are 
known when designing the code. Meanwhile, this code enables the 
highest transmission rate with decode-and-forward relaying. In 
addition, its regular degree distributions can easily be computed 
from the channel parameters, which significantly simplifies the 
code optimization. Numerical results are provided for both binary 
erasure channels (BEC) and AWGN channels. In BECs, we can 
observe that the gaps between the decoding thresholds and the 
Shannon limits are impressively small. In AWGN channels, the 
bilayer LDPC convolutional code clearly outperforms its block 
code counterpart in terms of bit error rate. 

I. Introduction 

The relay channel was introduced in 1971 when van der 
Meulen fll proposed a channel model consisting of one 
source, one relay, and one destination. The relay aids the 
communication between the source and the destination so that 
increased robustness, higher transmission efficiency, and/or 
larger coverage range can be achieved. As smallest but fun- 
damental unit of large network topologies, the relay channel 
has been extensively studied focusing on both theoretical and 
implementation aspects. 

Decode-and-forward (DF) relaying is the most researched 
protocol for relay channels. In particular, the design of dis- 
tributed channel codes has attracted considerable attention. 
The concept of distributed Turbo coding (DTC) was proposed 
in 111, which offered a new fashion of distributed code design. 
Low-density parity-check (LDPC) codes were considered for 
distributed coding for example in ||3|, ID and |I5|. Different 
approaches were presented to optimize LDPC codes for given 
channel conditions. For LDPC block codes, an irregular degree 
distribution needs to be derived to match a given channel. For 
a variety of channel conditions, extensive re-optimization is 
required. This leads to a high complexity for code adaptation 
and may not be feasible in practice. 

In this paper we propose to use LDPC convolutional codes 
for distributed channel coding in relay networks. LDPC con- 
volutional codes were first proposed in ||6] as a time-varying 
periodic LDPC code variation. Then the idea was further 
developed in, e.g., Q, ID. Recently, it has been proven 
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analytically in 19J that the belief-propagation (BP) decoding 
threshold of an LDPC convolutional code achieves the optimal 
maximum a posteriori probability (MAP) threshold of the 
corresponding LDPC block code with the same variable and 
check degrees. This code in turn approaches the capacity as 
the node degrees increase. Furthermore, regular LDPC convo- 
lutional codes allow us to avoid complicated re-optimization 
of the degree distributions for varying channel conditions. 
Meanwhile, LDPC convolutional codes enable recursive en- 
coding and sliding-window decoding |8J, which dispels the 
concerns over complexity and delay. Motivated by the good 
properties of LDPC convolutional codes, we consider in this 
paper the design of bilayer LDPC convolutional codes for 
the relay channel. A similar code construction was proposed 
in ifTOl for the wiretap channel. A protograph-based bilayer 
code was proposed in ifTTI which applies the concept of 
bilayer-lengthened codes. In contrast to ifTTI we present bilayer 
expurgated codes [5] in this paper 

In the following, we will discuss the construction of bilayer 
LDPC convolutional codes for given relay channels. We will 
prove analytically that the proposed bilayer code is capable of 
achieving the highest rate with DF relaying in binary erasure 
channels (BEC). Moreover, the regularity of degree distribu- 
tions significantly simplifies the code optimization. Numerical 
results are provided to verify the theoretical analysis. 

II. Preliminaries 

In this section, firstly we introduce the transmission model 
we use throughout the paper. Then we briefly review the 
coding strategy which leads to the highest achievable rate lfT2ll 
with DF relaying. The construction of bilayer codes |]5] is 
described as a practical realization of the coding strategy. 

A. System Model 

In this paper, we restrict ourself to the three-node relay 
channel which is composed of one source, one relay, and one 
destination. The source {S) intends to transmit its information 
to the destination {D) while the relay (i?) provides assistance. 

The system model is shown in Figure [T] Due to practical 
constraints the relay works in a half-duplex mode, which 
means it cannot transmit and receive at the same time or 
the same frequency. This implies that the transmission from 
the source to the destination is carried out in two phases. In 
the first phase, the source broadcasts while the relay and the 
destination listen. In the second phase, the relay transmits to 



the destination while the source keeps silent. We assume the 
transmissions on the three links to be orthogonal. 
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Fig. 1. Transmission model. 

In the following we use Xi, i G {S, R}, to denote the BPSK 
modulated signals which are transmitted from the source and 
the relay, and we use Yij, i G {S,R}, j G {R,D}, for 
the channel observations of the three links. We use Cy — 
I{Xi]Yij), i G {S,R}, j G {R,D} to denote the capacity 
of each link constrained to the BPSK modulation. In this 
paper we assume that perfect channel-state information (CSI) 
is available for code construction. 

B. Achievable Rate 

The highest transmission rate using decode-and-forward 
protocol for the half-duplex relay channel with orthogonal 
receive components is given as lfT2l 



Rdf ^ sup min{aI{Xs;YsR), 

a,0<a<l 



aI{Xs; Ysd) + {l-a)I{XR; Yrd)) 



(1) 



where a is the fraction of channel uses in the first phase, and 
(1 — a) is the fraction of channel uses in the second phase. 

To achieve Rdf, in the first phase the source employs 
a capacity-achieving code for the source-relay link which 
guarantees successful decoding at the relay. This code may 
not be decodable at the destination due to the poorer channel 
condition on the source-destination link. Therefore, in the sec- 
ond phase the relay forwards additional bits to the destination 
in order to construct an overall lower rate code which is 
capacity-achieving for the source-destination link. A practical 
implementation of the idea is presented in the following. 

C. Bilayer LDPC Block Codes for Relay Channels 

The construction of bilayer LDPC block codes fS] is real- 
ized in two steps corresponding to the two transmission phases. 

In the first phase, Ki information bits B are encoded by 
a length- A^i codeword X s through a rate-i?i LDPC code Ci 
(i.e., Ki = Ni-Ri) with the check matrix H s and transmitted. 
At the end of the first phase, the relay decodes Ci, using the 
check matrix H s, and recovers X s- 

At the destination, additional A'2 bits are needed for suc- 
cessfully decoding Xg: 

K2 = N,{I{Xs; Ysr) - I{Xs; Ysd))- 

Therefore, in the second phase the relay generates K2 new 
bits (syndrome, S) using the check matrix Hr. These K2 
syndrome bits are transmitted to the destination via a channel 
encoder C2 of rate R2 using N2 channel uses, i.e., K2 = 
N2-R2- To simplify the discussion, we assume these syndrome 



bits are perfectly known at the destination after decoding C2. 
Then the overall code C is described by the stacked check 
matrix H, and we have 



HXs^ 
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That is, at the destination (A^i — Ki) zero check equations 
and K2 non-zero check equations need to be satisfied in the 
decoding. The Tanner graph of a bilayer code example is 
plotted in Figure |2] 




Fig. 2. The Tanner graph of a bilayer LDPC code. Circles represent variable 
nodes, and squai'es indicate check nodes. The soHd lines correspond to the 
edges in H $, and the dashed lines show the connections determined by H n. 

To achieve the optimal performance, the design of Hs 
and H needs to guarantee that Ci and C are simultaneously 
capacity-achieving for the source-relay link and the source- 
destination link respectively. The authors of fSl approached 
this target by applying irregular LDPC block codes. Conse- 
quently, re-optimization is required for every given channel, 
which results in high complexity and infeasibility. In the next 
section we will show how this goal can be achieved by using 
regular LDPC convolutional codes leading to significantly 
reduced optimization overhead. 

If the channel codes Ci and C2 are both capacity-achieving, 
i.e., i?i = CsR. and R2 ~ Crd, then the achievable rate in 
^ is maximized by 

Ni ^ Crd 
^1 + ^2 Crd + CsR — CsD 
Later in this paper we will prove that in BECs Rdf can be 
achieved by applying bilayer LDPC convolutional codes. 

III. Bilayer LDPC Convolutional Codes 

A. LDPC Convolutional Codes 

A regular {l,r) time-varying binary LDPC convolutional 
code can be defined by a syndrome former matrix |l8l 



Hid) 



Hlil + w) 



H^t) 



Hlit + w) 



where I is the variable degree and r is the check degree. We 
assume that at each time instant t {t = 1,2, L) the number 
of variable nodes is A/. Then each submatrix Hf{t + i) is a 
M X (Ml/r) binary matrix. The largest i such that Hf(t + i) 
is nonzero for some t is called the syndrome former memory 
w. The matrix is sparse. 



There are many variations of LDPC convolutional codes in 
the Uterature. In this paper, we denote an LDPC convolutional 
code by four parameters {l,r, L,w}. The memory constraint w 
can be any non-negative integer We assume that each of the I 
edges of a variable node at time t uniformly and independently 
connects to the check nodes in the time range [t, ...,t + w]. 
More precisely, for each variable node at time t, one can 
define a type ^ which is a w-tuple of non-negative 

integers, Mt = {mt^t, —,mt,t+j, —,mt,t+w), j e [0,w], 
and ^t,t+j = I- The element rrit^t+j indicates that there 
are rrit^t+j edges connecting the designated variable node at 
time t and the check nodes at time t + j. For each variable 
node, Mt is uniformly and independently chosen from all 
possible types. It has been stated in ||9l that the {/, L, w} 
code ensemble is capacity achieving and easier to analyze. 
However, experimentally it shows a worse trade-off between 
rate, threshold and block length. 

Another variant, the {l,r,L} ensemble, can be considered 
as a special case of the more general code ensemble mentioned 
above. For this ensemble, the memory length w always equals 
Exactly one of the I outgoing edges of each variable node 
at time t is connected to one check node at position [<,..., i + 
{I — 1)], i.e., rrit^t+j — 1 for all j e [0,/ — 1]. We observe 
through experiments that this type of ensemble provides good 
performance with moderate M and L when I > 3. 

In this paper, we use the {I, r, L, w} ensemble for theoretical 
analysis while employing the {I, r, L} ensemble in simulations. 

B. Bilayer LDPC Convolutional Codes for Relay Channels 

Firstly, we define the structure of a bilayer LDPC convo- 
lutional code. We assume the number of variable nodes to be 
N = M ■ L. The connections between the N variable nodes 
and the check nodes in the first (second) layer are determined 
by the ensemble {^i, ri, L, wi} ({^2, '^2, L, ^2})- If = W2, 
we denote the bilayer code by {/i, Z2, ri, r2, L, w}. Note that 
only the edges belonging to the same layer are connected to 
one check node. The structure of the overall check matrix is 
illustrated in Figure |3] 



Fig. 3. Overall check matrix of a bilayer LDPC convolutional code. The 
white blocks correspond to the non-zero submatrices in the first layer, and the 
grey blocks are for those submatrices in the second layer 

The protocol for transmitting a bilayer LDPC convolutional 
code for the relay channel is similar to the strategy we 
explained in Section III-CI The information bits from the 
source are encoded by the single-layer code {/i, ri, L, wi] and 
broadcasted in the first phase. After successful decoding, the 
relay generates the syndrome bits using {l2,r2,L,W2}- These 
syndrome bits are transmitted to the destination under perfect 
protection by another channel code in the second phase. The 



destination decodes the overall code by considering the zero 
check equations in the first layer and the non-zero check 
equations in the second layer. 

C. Analysis for Binary Erasure Channels 

It has been shown in ||9l that the {l,r,L,w} ensemble with 
infinite M has the following properties in a binary erasure 
channel: for the rate of the code R 

lim lim R{l,r, L,w) = 1 , (3) 

w— >oo L— >oo T 

and for the decoding threshold 

lim lim €^P{l,r,L,w)= lim e*^^(?, r, L, «;) = e^^^(?, r), 

li'— >ooL— >oo L— >oo 

where e^^ and e^^^^ are respectively the BP threshold and 
the MAP threshold for decoding. If we increase the degrees 
of the nodes, its decoding threshold approaches the Shannon 
limit esh = 1 — R, 

lim lim lim {l,r, L,w) = esh- (4) 

r— >oo -iii— >oo L—^oo 

In the following, we will show in Theorem 2 that the 
bilayer LDPC convolutional code {li,l2,r,r, L,w} achieves 
the same Shannon limit as the standard single-layer ensemble 
{I I + l2,r,L,w} (TQ\ . As a preparation for the theorem, we 
introduce the following lemma. 

Lemma 1. If M, L and w go to infinity in this order, the 
density evolution of a single-layer LDPC convolutional code 
{Z,r, ijUi} in a binary erasure channel can be written as 

= and g« = 1 - (1 - /'))'-\ 

where p''' f^'^'j is the erasure probability from a variable 
(check) node to a check (variable) node in the i-th iteration, 
and e is the erasure probability of the channel. 



Proof: In the following we refer to the check nodes 
connected to a given variable node as the active check nodes 
for that variable node. We use p™^^*] to denote the probability 
that the message from a given variable node at time t to the 
m-th active check node at time t + j in decoding iteration i 
is erased. In the first iteration, p'tt+j = ^ for all m and j. We 
use qt+ft represent the probability that the message from 
the n-th active check node at i + j to the given variable node 
at t is erased. Then we have 



k=0.kyij 



n,{i-l) 
k,t 



"tt.t+j 



n=l 



n (5) 

v — l.v^m 

If M — s- 00, the messages from different nodes at the same 
time instant behave identically IS). Then (|5]l reduces to 



(0 



(^(.-1))™,.+,-!^ (6) 



Index of the variable node is omitted for the ease of notation. 



The messages from nodes at different time instants can 
behave differently and are usually tracked separately. However, 
if we have i — > cxd, the effect of boundaries caused by the 
initialization and the termination of the code vanishes. We can 



then consider the code asymptotically regular |fT3l . The mes- 
sage updating is averaged over w + 1 time instants. Therefore, 
if w oo, the messages from the nodes at different time 
instants have asymptotically identical distribution. Eventually, 
^ is simpUfied to 

Similarly, we also obtain 

gW = l-(l , 

Now we look at the relation between the bilayer LDPC con- 
volutional code ensemble {li,l2,r,r, L,w} and the standard 
single-layer ensemble {li + l2,r, L, w}. 

Theorem 2. UOV We denote a bilayer LDPC convolutional 
code of length N = M ■ L by {li,l2Tri,r2, L,w}, where li 
and I2 are respectively the variable degrees of the two layers, 
Ti, r2 are the check degrees of the two layers, and w is the 
common memory constraint. If we assume the two layers take 
the same check degree, i.e., ri = r2 = r, then the bilayer 
LDPC convolutional code {Zi, Z2, r, r, L, it;} approaches the 
same Shannon limit as the single-layer LDPC convolutional 
code {li + I2, r, L, w}. 

Proof: For the completeness of the proof, we repeat the 
derivation of the BP decoding threshold which was previously 
given in ifTOll . According to Lemma 1, we write for the first 
layer of the bilayer LDPC convolutional code, 

and g^^ = l-{l-j^Y~'- 
For the second layer of the code, we have 

=e(g(^-i))'i(g(^-i))'=-i and = 1 - (1 -p^'^P"!. 

Since ri = r2 = r and p9''' = p''2^ ~ e, we obtain from the 
iterations p\ = P2 ■ Then the recursion can be written as 

= e(l - (1 

This indicates that the bilayer LDPC convolutional code has 
the same BP threshold as the {li + l2,r,L,w} ensemble. 
The rate of the bilayer LDPC convolutional code satisfies 

h h 

lim lim Z2, r, r, L, u;) = 1 , (7) 

and the decoding threshold achieves the Shannon limit, 

lim lim lim e^^ {li,l2,r,r, L^w) = — + —. (8) 

According to (O and (|4]i, obviously the single-layer code 
{h + I2, r, L, w} has the same rate as in ^ and achieves the 
same limit as in ([8]l. Therefore, the theorem is proven. ■ 

For the design of bilayer LDPC convolutional codes in relay 
channels, firstly we choose an {li, r, L, w} ensemble which is 
capacity achieving for the source-relay link. Afterwards the re- 
lay generates the syndrome bits according to {l2,r, L,w} and 
forwards them to the destination. The overall code structure 
is consequently {li,l2,r,r, L,w}. In the following we will 
show this overall code is capacity achieving for the source- 
destination link. In addition, it enables the highest achievable 
rate Rdf of the relay channel. 



Theorem 3. For a binary erasure relay channel, we can find 
an LDPC convolutional code Ci = {li^r, L^w} achieving 
the capacity for the source-relay link and simultaneously its 
bilayer extension C ~ {hih, ^, ^, w} achieving the capacity 
for the source-destination link. Meanwhile, the above code 
construction provides the highest achievable rate with decode- 
and-forward relaying as in (|7]). 

Proof: We assume that the erasure probability for the 
source-relay link and the source-destination link are esR and 
esD, respectively, and 63 r < esD- The corresponding channel 
capacities for these two links are 

CsR = 1 — esi?, CsD = 1 — ^SD- 

We use a regular LDPC convolutional code {li,r, L,w} 
with li/r = esn^ for the transmission in the first phase. 
According to (O and (|4]i, we have 

lim lim R{li, r, L,w) ^ 1 3- = 1 — 65^ 

and lim lim lim e^^ (li,r, L,w) = csr. 

Hence, Ci is capacity achieving, and error-free decoding can 
be guaranteed at the relay. 

We assume that the number of variable nodes of Ci is Ny 
and the number of check nodes of Ci is Nqi, then 

Nci = hNv/r. 

The number of additional bits needed at the destination is 

Nc2 ~ Ny{Csr — Csd) = Nvi^sD — ^sr), 

and these bits are provided by the syndrome generated at the 
relay. At the destination, the total number of check nodes is 

Ji 

Nc = Nci + Nc2 = iVy - + ego - esR.) = esoNy. 

r 

The additional Nc2 check equations bring in rNc2 edges, and 
the corresponding variable degree I2 follows as 

I2 = rNc2/Nv = r{esD - esfl)- 
From Theorem 2, we have for the source-destination link 

lim lim R{li,l2,r,r,L,'w) = 1 ^— -— ^ = 1 — esD, 

and lim lim lim e^^ {li,l2,r,r, L,w) ^ eso- 

Therefore, the overall code C achieves the capacity of the 
source-destination link. 

The number of channel uses in the first phase is A^i = Ny. 
In the second phase, we can use another capacity-achieving 
LDPC convolutional code to transmit the Nc2 syndrome bits 
to the destination. Therefore, N2 = Nc2/Crd channel uses 
are needed. The fraction 

Ni Crd 
ot ~ = 

Ni + N2 Crd + CsR. — Csd 

equals the one in (|2|i, which maximizes the achievable rate. ■ 



From Theorem 3, we can conclude that the proposed reg- 
ular bilayer LDPC convolutional codes significantly simplify 
the code optimization. Appropriate variable and check node 
degrees can easily be computed from the parameters of the 
channels, and a complicated optimization of irregular degree 
distributions as for example in |5j can be avoided. 

IV. Numerical Results 

In this section, we firstly give numerical results for bilayer 
LDPC convolutional code ensembles {I, r, L} in binary erasure 
relay channels. The source broadcasts its information bits with 
an {/i = 3, r = 10, L = 100} LDPC convolutional code. At 
each time instant, the number of variable nodes is set to be 
M = 2000. At the relay, different values of h (h e {2, 3, 4, 5}) 
are chosen. Consequently, bilayer LDPC convolutional codes 
of different rates are constructed. Note that rate loss is in- 
evitable for finite L jS]. We compare the decoding thresholds 
of both the single-layer code and the bilayer codes with the 
corresponding Shannon limits. It can be seen from Figure 51 
that the gaps in between are impressively small. 
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Fig. 4. Bit erasure rate of bilayer LDPC convolutional codes with different 
overall rates in BECs. The solid curves show the simulation results, and the 
dashed lines indicate the Shannon limits. 

To evaluate the proposed bilayer LDPC convolutional codes 
under more practical conditions. Figure |5] shows the bit-error- 
rate performance for the AWGN channel. For comparison 
purpose, we also include a regular bilayer LDPC block code. 
For both types of the codes, we set li = 3, 12 = 2, and r — 10, 
which leads to approximately Rsr = 0.7 and Rsd — 0.5. 
In addition, the lengths of both codes are chosen in the way 
that the same hardware complexity fT] is needed. It can be 
observed that the bilayer LDPC convolutional code clearly 
outperforms its block code counterpart. Signal-to-noise ratio 
(SNR) gains of 0.5 dB and 1.3 dB are obtained at the relay 
and at the destination, respectively. 

V. Conclusions 

In this paper bilayer LDPC convolutional codes were pro- 
posed for three-node relay channels. For a binary erasure 
relay channel, we can find a bilayer LDPC convolutional 
code which is able to simultaneously achieve the capacities of 
the source-relay link and the source-destination link. Mean- 
while, this code provides the highest possible transmission 
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Fig. 5. Comparison of bit error rate between a bilayer LDPC convolutional 
code and a regular bilayer LDPC block code in AWGN channels. 

rate with decode-and-forward relaying. Moreover, the regular 
code structure significantly reduces the complexity by avoiding 
the optimization of irregular degree distributions. Numerical 
results were provided in both binary erasure channels and 
AWGN channels. In binary erasure channels, we can observe 
that the decoding thresholds are very close to the Shannon 
hmits. In AWGN channels, a significant gain in terms of SNR 
is achieved compared with its block code counterpart. 
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